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Abstract — In this work, we propose a new local optimization 
method to solve a class of nonconvex semideflnite program- 
ming (SDP) problems. The basic idea is to approximate the 
feasible set of the nonconvex SDP problem by inner positive 
semideflnite convex approximations via a parameterization 
technique. This leads to an iterative procedure to search a 
local optimum of the nonconvex problem. The convergence of 
the algorithm is analyzed under mild assumptions. Applica- 
tions in static output feedback control are benchmarked and 
numerical tests are implemented based on the data from the 
COMPLeib library. 

1. Introduction 

We are interested in the following nonconvex semidefl- 
nite programming problem: 

min fix) 

xeM" ' 

s.t. Fj(jt)^0, i=l,...,m, (NSDP) 

where / : W — > R is convex, £2 is a nonempty, closed con- 
vex set in R" and F; : R" — »• (z = 1 , . . . , m) are noncon- 
vex matrix-valued mappings and smooth. The notation A -< 
means that A is a symmetric negative semideflnite matrix. 
Optimization problems involving matrix-valued mapping 
inequality constraints have large number of applications 
in static output feedback controller design and topology 
optimization, see, e.g. [4], [10], [13], [18]. Especially, opti- 
mization problems with bilinear matrix inequality (BMI) 
constraints have been known to be nonconvex and NP- 
hard [3]. Many attempts have been done to solve these 
problems by employing convex semideflnite programming 
(in particular, optimization with linear matrix inequality 
(LMI) constraints) techniques [6], [7], [10], [11], [21]. The 
methods developed in those papers are based on augmented 
Lagrangian functions, generalized sequential semideflnite 
programming and alternating directions. Recently, we pro- 
posed a new method based on convex-concave decompo- 
sition of the BMI constraints and linearization technique 
[20]. The method exploits the convex substructure of the 
problems. It was shown that this method can be applied 
to solve many problems arising in static output feedback 
control including spectral abscissa, Jfy, JtfL, and mixed 
ffiijffloa synthesis problems. 

'Department of Electrical Engineering (ESAT/SCD) and 
Optimization in Engineering Center (OPTEC), Katholieke 
Universiteit Leuven, Belgium. Email: {quoc . trandinh, 
moritz .diehl}@esat . ku leuven . be 

'"Department of Computer Science and Optimization in 
Engineering Center (OPTEC), KU Leuven, Belgium. Email: 
wim ,michiels@cs . ku leuven . be 

*Department of Mathematics-Mechanics-Informatics, Hanoi University 
of Science, Hanoi, Vietnam. 



In this paper, we follow the same line of the work in [2], 
[15], [20] to develop a new local optimization method for 
solving the nonconvex semideflnite programming problem 
(INSDPt . The main idea is to approximate the feasible set 
of the nonconvex problem by a sequence of inner positive 
semideflnite convex approximation sets. This method can 
be considered as a generalization of the ones in [2], [15], 
[20]. 

Contribution. The contribution of this paper can be sum- 
marized as follows: 

1 . We generalize the inner convex approximation method 
in [2], [15] from scalar optimization to nonlinear 
semideflnite programming. Moreover, the algorithm 
is modified by using a regularization technique to 
ensure strict descent. The advantages of this algorithm 
are that it is very simple to implement by employing 
available standard semideflnite programming software 
tools and no globalization strategy such as a line- 
search procedure is needed. 

2. We prove the convergence of the algorithm to a sta- 
tionary point under mild conditions. 

3. We provide two particular ways to form an overes- 
timate for bilinear matrix-valued mappings and then 
show many applications in static output feedback. 

Outline. The next section recalls some definitions, notation 
and properties of matrix operators and defines an inner 
convex approximation of a BMI constraint. Section [3\ pro- 
poses the main algorithm and investigates its convergence 
properties. SectionQlshows the applications in static output 
feedback control and numerical tests. Some concluding 
remarks are given in the last section. 

2. Inner convex approximations 

In this section, after given an overview on concepts and 
definitions related to matrix operators, we provide a defi- 
nition of inner positive semideflnite convex approximation 
of a nonconvex set. 

A. Preliminaries 

Let 5f p be the set of symmetric matrices of size p x p, 
S?+, and resp., J^!f + be the set of symmetric positive 
semideflnite, resp., positive definite matrices. For given 
matrices X and Y in y p , the relation X >z Y (resp., X <Y) 
means that X - Y G (resp., Y -X G and X y Y 
(resp., X -< Y) is X - Y G &l + (resp., f-Xe The 
quantity Xo} 7 := trace(X r F) is an inner product of two 
matrices X and Y defined on S* p , where trace (Z) is the 
trace of matrix Z. For a given symmetric matrix X, kmm(X) 
denotes the smallest eigenvalue of X. 



Definition 2.1: [17] A matrix-valued mapping F : K" — >• 
y p is said to be positive semidefinite convex {psd-convex) 
on a convex subset C C R" if for all t 6 [0, 1] and x,y 6 C, 
one has 

F(?x + (1 -f)y) ^ fF(x) + (l-t)F(y). (1) 

If (HJ holds for -< instead of ^ for t £ (0, 1) then F is said 
to be strictly psd-convex on C. In the opposite case, F is 
said to be psd-nonconvex. Alternatively, if we replace -< 
in ([TJ by >z then F is said to be psd-concave on C. It is 
obvious that any convex function / : W —> K is psd-convex 
with p = 1- 

A function / : R" — )■ M is said to be strongly convex with 
parameter p > if /(•) — jp\\ ■ || 2 is convex. The notation 
df denotes the subdifferential of a convex function /. For a 
given convex set C, y^c(x) := {w \ w T (x — y) > 0, yeC} 
if x € C and jVcix) := if x ^ C denotes the normal cone 
of C at x. 

The derivative of a matrix-valued mapping F at x is a 
linear mapping DF from R" to W xp which is defined by 

« 

DF{x)h := £/;,■ — (x), V/; £ R". 
, = 1 aXi 

For a given convex set X S R", the matrix- valued mapping 
G is said to be differentiable on a subset X if its derivative 
DF(x) exists at every xeX. The definitions of the second 
order derivatives of matrix-valued mappings can be found, 
e.g., in [17]. Let A : W — > S^ p be a linear mapping defined 
as Ax : = £" =1 x,A,, where A, G y for i = l,...,n. The 
adjoint operator of A, A*, is defined as A*Z := (Ai oZ,A2 o 
Z, . . . ,A„ oZ) T for any Z e 

Finally, for simplicity of discussion, throughout this 
paper, we assume that all the functions and matrix-valued 
mappings are twice differentiable on their domain. 

B. Psd-convex overestimate of a matrix operator 

Let us first describe the idea of the inner convex approx- 
imation for the scalar case. Let / : R" — > R be a continuous 
nonconvex function. A convex function g(-;y) depending 
on a parameter y is called a convex overestimate of /(•) 
w.r.t. the parameterization y :— y{x) if g(x,\j/(x)) — f(x) 
and f(z) < g(z;y) for all y,z. Let us consider two examples. 
Example 1. Let / be a continuously differentiable function 
and its gradient V/ is Lipschitz continuous with a Lipschitz 
constant L f > 0, i.e. ||V/(y) - V/(*)|| <L||y-x|| for all 
x,y. Then, it is well-known that \f(z) —f(x) — Vf(x) T (z — 
x )\ < "2" lk — x\\ 2 . Therefore, for any x,z we have f(z) < 
g(z;x) with g(z;x) - f(x)+Vf(x) T (z-x) + ^\\z-x\\ 2 . 
Moreover, f(x) = g(x;x) for any x. We conclude that g(-;x) 
is a convex overestimate of / w.r.t the parameterization 
y = y/(x) = x. Now, if we fix x = x and find a point v 
such that g(v;x) < then /(v) < 0. Consequently if the set 
{x | f(x) < 0} is nonempty, we can find a point v such 
that g(v;x) < 0. The convex set ^(x) := {z \ g{z;x) < 0} is 
called an inner convex approximation of {z \ f(z) < 0}. 
Example 2. [2] We consider the function f(x) =x\X2 in M 2 . 
The function g(x,y) = ^x 2 + ^x 2 is a convex overestimate 
of / w.r.t. the parameterization y = y/(x) =x\/x2 provided 



that y > 0. This example shows that the mapping \j/ is not 
always identity. 

Let us generalize the convex overestimate concept to 
matrix-valued mappings. 

Definition 2.2: Let us consider a psd-nonconvex matrix 
mapping F : X C W — > Sf p . A psd-convex matrix mapping 
G(-;y) is said to be a psd-convex overestimate of F w.r.t. 
the parameterization y := y/(x) if G(x;y/(x)) = F(x) and 
F(z) di G{z\y) for all x,y and z in 3£ . 
Let us provide two important examples that satisfy Defini- 
tion 1221 

Example 3. Let 3S Q (X,Y) = X 1 Q~ l Y + Y 1 ' Q~ l X be a 
bilinear form with Q = Qi + Qi, Qi >~ and Q2 >- 
arbitrarily, where X and Y are two n x p matrices. We 
consider the parametric quadratic form: 

^ Q {X,Y-X,Y): = {X-X) T Q^{X-X) + {Y-Y) T Q^{Y-Y) 
+X T Q- l Y+Y T Q- l X+X T Q- l Y (2) 
+Y T Q- l X -X T Q- x Y-Y T QT l X. 

One can show that J2q(X ,Y;X ,?) is a psd-convex overes- 
timate of &q(X,Y) w.r.t. the parameterization \j/(X,Y) — 
(X,Y). 

Indeed, it is obvious that £ Q (X,Y;X,Y) = Sg Q {X,Y). 
We only prove the second condition in Definition 12.21 
We consider the expression 3) Q :=X J QT l Y + Y T ' Q~ X X + 
X T Q- 1 Y + Y T Q- l X - X T Qr l Y - Y T QX - X T Q~ l Y - 
Y T Q~ 1 X. By rearranging this expression, we can easily 
show that % = -(X -X) T Q- l (Y - Y) - (Y~Y) T Q- l (X - 
X). Now, since Q = Qi + Q2, by [1], we can write: 

-9 Q =(X-X) T (Q l +Q 2 )- 1 (Y-Y) 

+ (Y-Y) T (Q l +Q 2 y l (X-X) (3) 

d (x-x) t qy\x-x)+(y-Y) t Q2 \y-y). 

Note that % = £ Q - SS Q - (X -X) T Q~\X -X) + {Y - 
Y) T Q 2 \Y ~Y). Therefore, we have £ Q (X,Y;X,Y) t 
SSq{X,Y) for all X,Y and X,Y. 

Example 4. Let us consider a psd-noncovex matrix-valued 
mapping Sf(x) := Sf cvxl (x) - % vx2 (x), where £f cvxl and 
^cvx2 are t wo psd-convex matrix-valued mappings [20]. 
Now, let Sf C vx2 be differentiable and _S?2 (-*;-*) := ^cniix) + 
D^cvx2{x)(x~ x) be the linearization of ^ C vx2 atx. We define 
J^(x;x) := & C vxi{x) — ££i{x;5t). It is not difficult to show 
that Jt?(-;-) is a psd-convex overestimate of Sf(-) w.r.t. the 
parametrization \j/(x) = x. 

Remark 2.3: Example 3 shows that the "Lipschitz co- 
efficient" of the approximating function (f2| is (Qi,Q2)- 
Moreover, as indicated by Examples 3 and 4, the psd- 
convex overestimate of a bilinear form is not unique. In 
practice, it is important to find appropriate psd-convex 
overestimates for bilinear forms to make the algorithm 
perform efficiently. Note that the psd-convex overestimate 
J3q of £3q in Example 3 may be less conservative than the 
convex-concave decomposition in [20] since all the terms 
in £}q are related to X —X and Y — Y rather than X and Y. 



3. The algorithm and its convergence 

Let us recall the nonconvex semidefinite programming 
problem ( INSDPI l. We denote by 

&:={xeQ. \ Fi(x) ■< 0, i= l,...,m}, (4) 

the feasible set of (INSDPI l and 

^°:=ri(Q)n{jc G R" | F;(x)^0, i = l,...,m}, (5) 

the relative interior of jF, where ri(fi) is the relative interior 
of D.. First, we need the following fundamental assumption. 

Assumption A.l: The set of interior points of & is 
nonempty. 

Then, we can write the generalized KKT system of ( INSDPI l 
as follows: 



6 df(x) + LtiDFiixYWi + Jh(x), 
0hFi(x), WihO, Fi(x)oWi = 0, i=l,...,m. 



(6) 



Any point (x*,W*) with W* := (W?,...,W*) is called a 
KKT point of (INSDPI l. where x* is called a stationary point 
and W* is called the corresponding Lagrange multiplier. 

A. Convex semidefinite programming subproblem 

The main step of the algorithm is to solve a convex 
semidefinite programming problem formed at the iteration 
x k G Q. by using inner psd-convex approximations. This 
problem is defined as follows: 



min f{x) + \{x—x k ) T Qk{x—x k ) 



s.t. 



Gi(x;yf) 1 0, i 
x G £1. 



(CSDP(x*)) 



Here, G S^l is given and the second term in the objective 
function is referred to as a regularization term; y k :— l/^-(Jr ) 
is the parameterization of the convex overestimate G, of F[, 
Let us define by J^(x*,2fc) the solution mapping of 
CSDP(x*) d epending o n the parameters (x*,<2/t). Note that 
the problem CSDP(x A ) is conve x, 5^{5^;Q^ ) is multivalued 



and convex. The feasible set of 



CSDPQc*) 



is written as: 



&{5t) := jxGft | Gi(x-,Yi(x*)) d0, i=l,...,m\. (7) 



Sfep 3. Update y k+l := i//, 1 ) , the regularization 
matrix Qk+\ G (if necessary). Increase k by 1 and 
go back to Step 1. 

End. 

The core step of Algorithm Q] is Step 2 where a general 
convex semidefinite program needs to be solved. In practice, 
this can be done by either implementing a particular method 
that exploits problem structures or relying on standard 
semidefinite programming software tools. Note that the 
regularization matrix can be fixed at = pi, where 
p > is sufficiently small and / is the identity matrix. 
Since Algorithm [TJ generates a feasible sequence {x k }k>o to 
the original problem ( INSDPI l and this sequence is strictly 
descent w.r.t. the objective function /, no globalization 
strategy such as line-search or trust-region is needed. 

C. Convergence analysis 

We first show some properties of the feasible set J^"(x) 
defined by (0. For notational simplicity, we use the notation 

ll-ll 2 e :=(-) r e(-)- 

Lemma 3.1: Let {x k }k>o be a sequence generated by 
Algorithm Q] Then: 

a) The feasible set ^{x k ) C & for all k > 0. 

b) It is a feasible sequence, i.e. {x k }k>o C & . 

c) x k+1 £.^{x k )f\^{x k+l ). 

d) For any k > 0, it holds that: 

1 



f{ X k+l )<f{x k )--\[ 



Jc+1 



■k\\2 

He* 



2 11 



where p/ > is the strong convexity parameter of /. 

Proof: For a given x k , we have y k = yi{x k ) and 
Fi(x) d Gi{x;y k ) < for i = l,...,m. Thus if x G 
then x G the statement a) holds. Consequently, the 
sequence {x^} is feasible to dNSDPI ) which is in deed the 
statement b). Since x k+l is a solution of CSDP^) it shows 



that x k+l G .^(x k ). Now, we have to show it belongs to 
Indeed, since G i (x k +\y k+l ) = Fi(x k+l ) d by 
Definition 12.21 for all i = l,...,m, we conclude x k+l G 
^{x k+l ). The statement c) is proved. Fi nally, we p rove 



B. The algorithm 

The algorithm for solving ( INSDPI l starts from an initial 
point Jr G and generates a sequence {x*},t>o by solving 
a seq uence of c onvex semidefinite programming subprob- 
lems CSDP(i*) approximated at Jr. More precisely, it is 



d). Since x + is the optimal solution of CSDP^) 
have J- — v A 'll 2 <- rtrUl/T - TFTi 

x k )- P i\\x 



pfe+l||2 



</(*) + 4 (x-^CtC* 



for all ie/(f). However, we have 
x k G ^"(i*) due to c). By substituting x = in the previous 
inequality we obtain the estimate d). ■ 
Now, we denote by S£f{a) :— {x G & \ fix) < a} the 
lower level set of the objective function. Let us assume 
that Gi(-;y) is continuously differentiable in j2/-(/(jc°)) for 
any y. We say that the Robinson qualification condition for 
CSDP (x*)| holds at x if G int(G,(x;yf ) +D x G i (x;f i )(Q. - 
Initialization. Determine an initial point I u G ^F u . Compute x)+,Y+) for i = 1 , . . . , m. In order to prove the convergence 



presented in detail as follows. 

ALGORITHM 1 {Inner Convex Approximation): 



tfl := for i=l,...,m. Choose a regularization matrix 

g GJ^. Set k:=0. 

Iteration k (k = 0, 1,...) Perform the following steps: 

Step 1. For given x k , if a given criterion is satisfied 
then terminate. 

Step 2. Solve the convex semidefinite program 



of Algorithm Q] we require the following assumption. 

Assumption A.2: The set of KKT points of (INSDPI l 
is nonempty. For a given y, the matrix-valued mappings 
Gi{-;y) are conti nuously dif ferentiable on «5ff (/(x )). The 
convex problem 



CSDPfx* 



CSDP(x*) 



to obtain a solution x k+l and the corre- 
sponding Lagrange multiplier W k+1 . 



is solvable and the Robinson 
qualification condition holds at its solutions. 
We note that if Algorithm 1 is terminated at the iteration k 
such that x k = x + then x k is a stationary point of ( INSDPI l. 



Theorem 3.2: Suppose that Assumptions AQ] and A|2] 
are satisfied. Suppose further that the lower level set 
^/(/(I )) is bounded. Let {(x k ,W k )} k > i be an infinite 
sequence generated by Algorithm [TJ starting from x° G 
Assume that hnaxiQk) <M< +°o. Then if either / 
is strongly convex or A m i n (2i ; ) > p > for k > then 
every accumulation point (x*,W*) of {(x k ,W k )} is a KKT 
point of dNSDPI ). Moreover, if the set of the KKT points 
of ( INSDPI l is finite then the whole sequence {(x k ,W k )} 
converges to a KKT point of (INSDPb . 

Proof: First, we show that the solution map- 
ping 5^(j^ ,Qk) is closed. Indeed, by Assumption Af2] 



CSDP(x ) is feasible. Moreover, it is strongly convex. 
Hence, ^{x^^Q^) = {x^ 1 }, which is obviously closed. 
The remaining conclusions of the theorem can be proved 
similarly as [20, Theorem 3.2.] by using Zangwill's con- 
vergence theorem [22, p. 91] of which we omit the details 
here. ■ 
Remark 3.3: Note that the assumptions used in the proof 
of the closedness of the solution mapping ,S fi (-) in Theorem 
13.21 are weaker than the ones used in [20, Theorem 3.2.]. 

4. Applications to robust controller design 

In this section, we present some applications of Algo- 
rithm[TJfor solving several classes of optimization problems 
arising in static output feedback controller design. Typi- 
cally, these problems are related to the following linear, 
time-invariant (LTI) system of the form: 



x = Ax - 
z = C\x 
y = CX + D21W. 



Biw + Bu, 
-D\iw + Di2ii, 



(8) 



is the state vector, w G 1 
l n " is the input vector, z G - 



""' is the performance 
l" z is the performance 



where x G 
input, u G 

output, y G R" v is the physical output vector, A G IR" X " is 
state matrix, B G R" x "« is input matrix and C G R" vX " is the 
output matrix. By using a static feedback controller of the 
form u = Fy with F G R"" x " v , we can write the closed-loop 
system as follows: 



xf 
z - 



-Apxp +Bpw, 
■ CfXf + Df\v. 



The stabilization, J^f, ML optimization and other control 
problems of the LTI system can be formulated as an 
optimization problem with BMI constraints. We only use 
the psd-convex overestimate of a bilinear form in Example 
3 to show that Algorithm Q] can be applied to solving many 
problems ins static state/output feedback controller design 
such as: 

1 . Sparse linear static output feedback controller design; 

2. Spectral abscissa and pseudospectral abscissa opti- 
mization; 

3. Mi optimization; 

4. ML optimization; 

5. and mixed Mij M>o synthesis. 

These problems possess at least one BMI constraint of the 
from B/(X,T,Z) < 0, where B/(X,F,Z) := X T Y + Y T X + 
&/(Z), where X,Y and Z are matrix variables and srf is a 



affine operator of matrix variable Z. By means of Example 
3, we can approximate the bilinear term X T Y +Y T X by its 
psd-convex overestimate. Then using Schur's complement 
to transform the constraint G,(x;x k ) ^ of the subproblem 



CSDP(x A ) into an LMI constraint [20]. Note that Algorithm 



T] requires an interior starting point x° G In this work, 
we apply the procedures proposed in [20] to find such a 
point. Now, we summary the whole procedure applying to 
solve the optimization problems with BMI constraints as 
follows: 
Scheme A.l: 

Step 1. Find a psd-convex overestimate Gi(x;y) of Fi{x) 
w.r.t. the parameterization y = y/i(x) for i — l,...,m (see 
Example 1). 

Step 2. Find a starting point x° G J^" (see [20]). 

form the convex semidefinite 
and reformulate it as an 



Step 3. For a given x 



programming problem CSDP(x ) 



optimization with LMI constraints. 

Step 4. Apply Algorithm [TJ with an SDP solver to solve 
the given problem. 

Now, we test Algorithm Q] for three problems via numerical 

examples by using the data from the COMPl e ib library 

[12]. All the implementations are done in Matlab 7.8.0 

(R2009a) running on a Laptop Intel(R) Core(TM)i7 Q740 

1.73GHz and 4Gb RAM. We use the YALMIP package 

[14] as a modeling language and SeDuMi 1.1 as a SDP 

solver [19] to solve the LMI optimization problems 

arising in Algorith m [TJ at the initial phase (Phase 1) 

and the subproblem CSDP^) The code is available at 

http : // www . kuleuven . be/ opt ec/ soft ware /BMI solver 

We also compare the performance of Algorithm [TJ and 

the convex-concave decomposition method (CCDM) 

proposed in [20] in the first example, i.e. the spectral 

abscissa optimization problem. In the second example, 

we compare the ,3^L-Viorm computed by Algorithm [T] and 

the one provided by HIFOO [8] and PENBMI [9]. The 

last example is the mixed H2/H00 synthesis optimization 

problem which we compare between two values of the 

//2 -norm level. 



(9) A. Spectral abscissa optimization 



We consider an optimization problem with BMI con- 
straint by optimizing the spectral abscissa of the closed- 
loop system i = (A+BFC)x as [5], [13]: 



max /3 

S.t. 



(A+BFC) T P+P{A 
P = P T , PyO. 



-BFC)+2j5P-<0, ( 10 ) 



Here, matrices A G M" xn , B G R" x "" and C G R" vX " are 
given. Matrices P G M" xn and F G R n " xn y and the scalar 
P are considered as variables. If the optimal value of ( fTOb 
is strictly positive then the closed-loop feedback controller 
u = Fy stabilizes the linear system x = (A + BFC)x. 

By introducing an intermediate variable Ap :=A+BFC + 
pV, the BMI constraint in the second line of ( fTOb can be 
written ApP + P T Af -< 0. Now, by applying Scheme Q] one 
can solve the problem ( fTOb by exploiting the Sedumi SDP 



solver [19]. In order to obtain a strictly desc ent direc- 
tion, we regularize the subproblem CSDPfx^) by adding 
quadratic terms : p F \\F -F k \\ 2 F +p P \\ P-P k \\ F +p f | j3 - & | 2 , 
where pp — pp = Pf = 10~ 3 . Algorithm Q] is terminated if 
one of the following conditions i s satisfied: 

• the subproblem CSDP^) encounters a numerical 
problem; 

. |]^ +1 -^||oo/(||^||~ + l)<l(r 3 ; 

• the maximum number of iterations, K max , is reached; 

• or the objective function of ( INSDPI l is not significantly 
improved after two successive iterations, i.e. \f k+1 — 
f \ < 1(T 4 (1 + \f k \) for some k = k and k = k+l, 
where J* := f(x k ). 

We test Algorithm Q] for several problems in COMPl e ib and 
compare our results with the ones reported by the convex- 
concave decomposition method (CCDM) in [20]. 

TABLE I 

Computational results for {To} in COMPl e ib 



Problem 


(Jonvex-Concave Decom. 


Inner Convex App. 


Name 




CCDM 


iter 


time [ s ] 


Oo(A F ) 


Iter 


time [ s ] 


AC1 


0.000 


-0.8644 


62 


23.580 


-0.7814 


55 


19.510 


AC4 


2.579 


-0.0500 


14 


6.060 


-0.0500 


14 


4.380 


AC5 a 


0.999 


-0.7389 


28 


10.200 


-0.7389 


37 


12.030 


AC7 


0.172 


-0.0766 


200 


95.830 


-0.0502 


00 


80.710 


ACit 


0.012 


-0.0755 


24 


12.110 


-0.0640 


40 


32.340 


AO 


0.012 


-0.4053 


100 


55.460 


-0.3926 


200 


217.230 


AC11 


5.451 


-5.5960 


200 


81.230 


-3.1573 


181 


73.660 


AC12 


0.580 


-0.5890 


200 


61.920 


-0.2948 


200 


71.200 


HE1 


0.276 


-0.2241 


200 


56.890 


-0.2134 


200 


58.580 




0.087 


-0.9936 


200 


98.730 


-0.8380 


57 


54.720 


HH4 


0.234 


-0.8647 


63 


27.620 


-0.8375 


88 


70.770 


HE5 


0.234 


-0.1115 


200 


86.550 


-0.0609 


200 


181.470 


HE6 


0.234 


-0.0050 


12 


29.580 


-0.0050 


18 


106.840 


REA1 


1.991 


-4.2792 


200 


70.370 


-2.8932 


200 


74.560 


RKA2 


2.011 


-2.1778 


40 


13.360 


-1.9514 


4 J i 


13.120 


RMA3 


0.000 


-0.0207 


200 


267.160 


-0.0207 


161 


311.490 


D1S2 


1.675 


-8.4540 


28 


9.430 


-8.3419 


44 


12.600 


D1S4 


1.442 


-8.2729 


95 


40.200 


-5.4467 


89 


40.120 


WEC1 


0.008 


-0.8972 


200 


121.300 


-0.8568 


68 


76.000 


1H 


0.000 


-0.5000 


7 


23.670 


-0.5000 


11 


82.730 


G'SEl 


0.000 


-0.3093 


81 


219.910 


-0.2949 


200 


1815.400 


TF1 


0.000 


-0.1598 


87 


34.960 


-0.0704 


200 


154.430 


TF2 


0.000 


-0.0000 


8 


4.220 


-0.0000 


12 


10.130 


TF3 


0.000 


-0.0031 


93 


35.000 


-0.0032 


95 


70.980 


NN1 


3.606 


-1.5574 


200 


57.370 


0.1769 


200 


59.230 


NN5" 


0.420 


-0.0722 


200 


79.210 


-0.0490 


200 


154.160 


NN9 


3.281 


-0.0279 


33 


11.880 


0.0991 


44 


13.860 


NN13 


1.945 


-3.4412 


181 


64.500 


-0.2783 


32 


12.430 


NN15 


0.000 


-1.0424 


200 


58.440 


-1.0409 


200 


60.930 


NN17 


1.170 


-0.6008 


99 


27.190 


-0.5991 


132 


34.820 



The numerical results and the performances of two algo- 
rithms are reported in Table [I] Here, we initialize both 
algorithms with the same initial guess F° = 0. 

The notation in Table U consists of: Name is the name 
of problems, do (A), OCo(Ap) are the maximum real part of 
the eigenvalues of the open-loop and closed-loop matrices 

A, Ap, respectively; iter is the number of iterations, 
time[s] is the CPU time in seconds. Both methods, 
Algorithm Q] and CCDM fail or make only slow progress 
towards a local solution with 6 problems: AC18, DIS5, 
PAS, NN6, NN7, NN12 in COMPl e ib. Problems AC5 and 
NN5 are initialized with a different matrix F° to avoid 
numerical problems. The numerical results show that the 
performances of both methods are quite similar for the 
majority of problems. 

Note that Algorithm Q] as well as the algorithm in [20] 
are local optimization methods which only find a local 
minimizer and these solutions may not be the same. 

B. ML optimization: BMI formulation 

Next, we apply Algorithm Q] to solve the optimization 
with BMI constraints arising in ML optimization of the 



linear system ©. In this example we assume that D21 = 0, 
this problem is reformulated as the following optimization 
problem with BMI constraints [12]: 



mm 

F,x,y 



s.t. 



ApX 



XA F 



B\X 

c F 

X>-0, y>0. 



XBi 



C T p' 
~7h 



■<0, 



(11) 



Here, as before, we define Ap :—A+BFC and Cp := C\ + 
DnFC. The bilinear matrix term ApX +XAp at the top- 
corner of the first constraint can be approximated by the 
form of <&q defined in ©. Therefore, we can use this psd- 
convex overestimate to approximate the proble m (fTTT) by a 



sequence of the convex subproblems of the form CSDP(i*) 
Then we transform the subproblem into a standard SDP 
problem that can be solve by a standard SDP solver thanks 
to Schur's complement [1], [20]. 

To determine a starting point, we perform the heuristic 
procedure called Phase 1 proposed in [20] which is termi- 
nated after a finite number of iterations. In this example, 
we also test Algorithm Q] for several problems in COMPl e ib 
using the same parameters and the stopping criterion as 
in the previous subsection. The computational results are 
shown in Table [TT] The numerical results computed by 
HIFOO and PENBMI are also included in Table HH 

Here, three last columns are the results and the perfor- 
mances of our method, the columns HIFOO and PENBMI 
indicate the ML-noim of the closed-loop system for the 
static output feedback controller given by HIFOO and 
PENBMI, respectively. We can see from Table [II] that 
the optimal values reported by Algorithm Q] and HIFOO 
are almost similar for many problems whereas in general 
PENBMI has difficulties in finding a feasible solution. 



C. M2I 'ML optimization: BMI formulation 

Motivated from the ML optimization problem, in this 
example we consider the mixed M%l ML synthesis opti- 
mization problem. Let us assume that D\ \ =0, D21 = and 
the performance output z is divided in two components, z\ 
and Z2- Then the linear system (0 becomes: 



x =Ax + Biw + Bu, 



Z\ 

Z2 

y = 



= Cfx- 
= Cfx- 
Cx. 



■Df 2 u, 
-Df 2 u, 



(12) 



The mixed Mij 'ML control problem is to find a static 
output feedback gain F such that, for u = Fy, the Mi- 
norm of the closed loop from w to zi is minimized, while 
the ML-noim from w to z\ is less than some imposed level 
7 [4], [13], [16]. 

This problem leads to the following optimization problem 



TABLE II 

,%L SYNTHESIS BENCHMARKS ON COMPL E IB PLANTS 



Problem information 


Other Results, .XU 


Results and Performances 


Name 


"v 






/(- 


n» 


Hlt-00 


PENBM1 


ML 


i t e r 


timet s ] 


AC2 




J 


i 


3 


3 


0.1115 


- 


0.1174 


120 


91.560 


AC'i 




4 


2 


3 


3 


4.7021 


- 


3.5053 


267 


193.940 


AC 6 


/ 


4 


2 


/ 


/ 


4.114U 




4.1954 


167 


1 38.3/0 


AC7 


y 


2 


1 


1 


4 


0.0651 


0.3810 


0.0339 


3U0 


276.3 10 


ACS 


9 


^ 


1 


1 


lo 


2.0050 




4.5463 


224 


230. 990 


ACll* 


5 


4 


2 


5 


5 


3.5603 


- 


3.4924 


300 


255.620 


AC15 


4 


J 


2 


6 


4 


15.2074 


427.4106 


15.2036 


153 


130.660 


AC16 


4 


4 


2 


6 


4 


15.4969 


- 


15.0433 


267 


201.360 


ACT/ 


4 


2 


1 


4 


4 


6.6124 


■ 


6.6571 


192 


64.880 


HE1" 


4 


1 


2 


2 


2 


0.1540 


1.5258 


0.2188 


300 


97.760 


HE3 


8 





4 


lo 


1 


0.S545 


1.6843 


0.8640 


13 


16.320 


HE5" 


8 


2 


4 


4 


3 


8.8952 


- 


36.3330 


154 


208.680 


REA1 


4 


J 


2 


4 


4 


0.8975 


- 


0.8815 


183 


67.790 


REA2" 


4 


2 


2 


4 


4 


1.1881 




1.4444 


300 


109.430 


REA3 


12 




1 


12 


12 


74.2313 


74.4460 


75.0634 


2 


137.120 


D1S1 


8 


4 


4 




1 


4.1716 




4.2041 


129 


1 10.330 


D1S2 


J 


2 


2 


3 


3 


1.0348 


1.7423 


1.1570 


78 


28.330 


DIS3 


3 


3 


3 


2 


3 


1.0816 




1.1701 


219 


160.680 


D1S4 


6 


6 


4 


6 


6 


0.7465 


_ 


0.7532 


171 


126.940 


TGl b 


10 


2 


2 


10 


10 


12.8462 




12.9461 


64 


264 050 


AGS 


12 


2 


2 


12 


12 


8.1732 


188.0315 


8.1733 


41 


160.880 


VVEC2 


10 


4 


•i 


10 


10 


4 2726 


32 99 55 


8 8809 


300 


1341 760 


WEC3 


lo 


4 


3 


10 


10 


4.4497 


200.1467 


7.8215 


225 


875.100 


BDT1 


II 


3 


3 


6 


1 


0.2664 




0.8544 


3 


5.290 


MFP 


4 


2 


3 


4 


4 


31.5890 


_ 


31.6388 


300 


100.660 


1H 


21 


10 


11 


11 


21 


1.9797 


_ 


1.1861 


210 


2782.880 


CSE1 


20 


10 


2 


12 


1 


0.0201 




0.0219 


3 


3<).330 


PSM 


7 


i 


2 


5 


2 


0.9202 




0.9266 


153 


104.170 


EB1 


lo 


1 


1 


2 


2 


3.1225 


39.9526 


2.0532 


300 


299.380 


EB2 


10 


1 


1 


2 


2 


2.0201 


39.9547 


0.8150 


120 


103.400 


EB3 


10 


1 


1 


2 


2 


2.0575 


3995311.0743 


0.8157 


117 


116.390 


NN2 


2 


1 


1 


2 


2 


2.2116 




2.2216 


15 


7.070 


NN4 


4 


J 


2 


4 


4 


1.3627 




1.3884 


204 


70.200 


NN8 


J 


2 


2 


3 


3 


2.8871 


78281181.1490 


2.9522 


240 


84.510 


NN11 6 


16 


5 


3 


3 


3 


0.1037 




0.1596 


15 


86.770 


NN15 


J 


2 


2 


4 


1 


0.1039 




0.1201 


6 


4.000 


NN16 


8 


4 


4 


4 


8 


0.9557 




0.9699 


36 


32.200 


NN17 


3 


1 


2 


2 


1 


11.2182 




11.2538 


270 


81.480 



with BMI constraints [16]: 
min trace (Z) 

F,P l ,P 2 ,Z 



s.t. 



AjP 1 +P 1 A f + (C> I ) r Cp P\B\ 



BjPi 



A l F P 2 +P 2 A F P 2 Bi 

B\P 2 -I 
Pi {Cff 

cf z 



> 0, Pi > 0, P 2 > 0, 



(13) 



where Af -A+BFC, C' 1 \=C\ 



D\ l 2 FCwdCf :=Cf - 



Df 2 FC. Note that if C = I„ x , the identity matrix, then this 
problem becomes a mixed M^j ML of static state feedback 
design problem considered in [16]. 

Now, we implement Algorithm Q] for solving the problem 
( fl~3b . As before, we use a procedure proposed in [20] 
to determine a starting point for Algorithm Q] We test 
the algorithm described above for several problems in 
COMPl e ib with the level values y = 4 and 7= 10. In this 
test, we assume that the output signals z\ = z 2 - Thus we 
have Cj 1 ~ Cj 2 = C\ and D\ l 2 = Df 2 =D\ 2 . The parameters 
and the stopping criterion of the algorithm are chosen as in 
the Hoo problem. The computational results are reported in 
Table Uri] with 7 = 4 and 7= 10. Here, 3ft /3%L are the M\ 
and ML norms of the closed-loop systems for the static 
output feedback controller, respectively. With 7= 10, the 
computational results show that Algorithm [TJ satisfies the 
condition ||Poo(s) ||oo < 7= 10 for all the test problems, the 
problems AC 11 and AC 12 encounter a numerical problems 
that Algorithm [TJ can not solve. While, with 7 = 4, there 
are 6 problems reported infeasible, which are denoted by 
The J^L-constraint of three problems AC11 and NN8 
is active with respect to 7 = 4. 



TABLE III 

,M_I,%L SYNTHESIS BENCHMARKS ON COMPL E IB PLANTS 



Proo 


Results (7 = 4) 


Results (7= 10) 


Name 


■M2 Mm 


iter 


time[ s ] 




iter 


timet s ] 


kn \ — 1 

At_ 1 


0.0587/0.0993 




Z 


n TT7T 

2.410 


0.U5S7/0.0994 


r 

I 


") AAA 

z.OOO 


kn*> — 

ALZ 


a 1 in 1 in 1 tot 
0.1071/0.1730 


1 


2.920 


A 1 ATI 711 1 TOT 

0.1071/0.1730 


1 


2. /2U 


AC j 


-/- 






4.5720/5.1337 


57 


94.620 


ALo 


1 — ! 

-/- 






3.995 1/5.37S9 


TCT 

Z6 


— T77T 

6 1 .460 


An — 


0.(14 38/0.06 10 


34 


5U.U8U 


a m a 1 711 nz 1 1 
0.0441/0.0611 


3 


6. 1 10 


ACl 1 


4.0914/3.9983 


1 1U 


I30.34U 


-/- 






AC Iz 


0.0924/0.3486 




/3.4o 


7- 

-/- 






A 1 7 

AC1 / 


-/ - 


" 




4.2061/6.6126 




100.130 


TIE 1 — ! 

Hbl 


0.0973/0.2046 


1 


34.860 


A A ATI /A TJ1TE 

0.0973/0.2075 


1 


3 b. 260 


um — 1 


— 7 — 1 

- / - 


" 




4.7326/9.S059 




AT £ / A 

9 / .j 60 


r> r A 1 

KnAl 


1 DTPm I TAT 

1.8217/1.4795 


5 1 


23.14U 


1.8296/1.4495 


300 


1 T^ TAA 

172.700 


KbAz 


3.5021/3.5122 




3o.o3U 


3.5024/3.4913 


TTT 

141 


1 A7 1 OA 

lO/.loO 




-/- 






4.2341/4.6736 


44 


275.280 


D1S2 


1.5080/1.8410 


45 


17.960 


1.5080/1.8400 


45 


20.280 


D1S3 


2.0580/1.7969 


60 


68.530 


2.0579/1.7727 


66 


136.280 


D1S4 


1.6932/1.1899 


72 


69.000 


1.6932/1.1899 


72 


68.120 


AGS 


- / - 






7.0356/8.2053 


9 


82.160 


PSM 


1.5157/0.9268 


237 


241.210 


1.5158/0.9269 


264 


281.580 


KB2 


0.902370.8142 


1 


124.200 


0.9012/0.8142 


1 


122.170 


HB3 


0.9144/0.8143 


1 


123.470 


0.9137/0.8143 


1 


126.810 


NN2 


1.5652/2.4771 


18 


20.540 


1.5651/2.4811 


24 


37.010 


NN4 


1.8778/2.0501 


202 


154.49 


1.8928/2.2496 


257 


139.900 


NNtf 


2.3609/3.9999 


21 


15.71 


2.3383/4.5520 


99 


68.700 


NN15 


0.0490/0.1366 


24 


52.410 


0.0488/0.1392 


27 


49.940 


NN16 


0.3544/0.9569 


108 


126.160 


0.3910/0.9573 


300 


405.340 



5. Concluding remarks 

We have proposed a new iterative procedure to solve a 
class of nonconvex semidefinite programming problems. 
The key idea is to locally approximate the nonconvex 
feasible set of the problem by an inner convex set. The 
convergence of the algorithm to a stationary point is inves- 
tigated under standard assumptions. We limit our applica- 
tions to optimization problems with BMI constraints and 
provide a particular way to compute the inner psd-convex 
approximation of a BMI constraint. Many applications in 
static output feedback controller design have been shown 
and two numerical examples have been presented. Note 
that this method can be extended to solve more general 
nonconvex SDP problems where we can manage to find an 
inner psd-convex approximation of the feasible set. This is 
also our future research direction. 
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